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<g) A meitiod or passfng task messages In a data pfooesslfigsystm 



® PyDoessors 5, 7 oommuntesfively sttadied to a 
storaQs siit>^y8lBm 3 pisos task messaoes for the 
s u twystsm on a queue. Tho processor s do not have 
to wait on a queue lock set by another processor or 
suty-systsm whDsl dequat^ s message. IMs Is 
achieved by use of a double ended linked fist or 



queue of messages having an teotetoi/iwference 
pdnt wherain an enqueubig end of Oie list Is k)o- , 
IcBbie and aooessible I ndspe m te n tty from the de- 
queuing end of the fist Ihe lockkig prfanlfive may be 
of Ifie nuilt^prooe s sor lock synchnonlibig .atomic 
type such as TEST AND SET. - 
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noM of ths fcivwtton 

This Invmtlon relates to a method and means 
for passing messages between pnooessors having 
order of magnitude speed differences to avoid the 
rate of message e»c»»nge being dominated by the 
lower speed. Such message passing oocure be- 
tween conoffrently executing CPU's and an exter- 
nal storage aub-syetem (e.g. synchronous <firect 
aooess storage devloe (DASO) array). 

Background of the Invention 

Contemporary high speed processing or super* 
computing conjures up me prospect of 1000 mOlkm 
instnictioiia per second (MIPS) of coonfinale com- 
puting across multiple processor s aperiodic^ 
ferendng substantiaify slower spedafaed proces- 
sors such 88 direct access storege device (DASD) 
anray controOers. Synchronization among proces- 
sors sQI requires a combination of lodes and mes- 
sages. Lodes serve to bind resoinces to taslcs while 
messages and th^ processing operate as syn- 
chronizing events. In contsmpdary systems, task 
ortonlad m essages are enQueued agdnst re- 
sources. Mso. the queued access is governed by a 
Global lock. Thus, operations are paced by the 
slowest processor oMtfning locked access to the 
queue. 

A sir^ central processing untt (CPU) or pro- - ; 
cesser typk:a»y indudes a kxal operating system 
(DSK RAM implemented Memal memory, tocal 
InstnictkNi and .^lata caches operatively ..formed 
from the tntemal memory, an eodemal store, and . 
kwk, cache, md storage rasouroe managers. How- 
over, Mgh tpoo d or superoomputing Involves ap- 
pBcafions ONBOuting over several processor s. The 
appGcafions Initiate tasks in the form of OS inslnjo- 
tions (READAMVTE). Ttiese tasks are queued 
agafrist the resources whteh process them. In this 
case, these are the general ar^ spedal purpose 
processofs of the Wgh speed system. The tasks 
are relativeiy synchronized (ordered) with respect 
to each other by meir positkm placement as mes- 
sages In the queue In a commonly accessible 
portion of processor shared internal memory. 

The messages (tasks) are expressed as encap- 
sulated operations defined over a range of ad- 
dresses. Where the messages relate lo accessing 
external storage, they are enqueued t>y processors 
in the sfiared memory and await dequeuing and 
execution by the storage sub-system. Concurrently, 
messages Indicative of altered or completed stor- 
age access tasks ana also enqueued tiy the storage 
sub-system in the aharsd memory and await de- 
queuing and exacutlon t>y the processors. By lock- 
ing th queue, tfie skiwest processor such as the 
xtemat store (array controller) can pace the entire 



As menttoned above, eynchronlzatton Is 
achieved among processors and tasks using 
queued access messages usually controlled by 
6 some form of kKklng. However, where there is a 
raw disparity in capacities, then much may go to 
waste while the fester processor awaits access to a 
queue currently bound (k)cked) to a substantially 
slower processor. 

10 Even where the processor eng^es external 
DASO storage without delay, there may bo a gross 
mismatch of data ratoa tBustrativeiy. concurrent 
processore executing 100 IMIPS and a 100 
MBytes data transfer rate might have to commu- 

16 nicala wHh a gigabyte DASD having a 1 to 3 MByte 
transfer rats and a 10 miSseoond access time. 

Pattereon et al. 'A Case for Redundant Arrays 
of Inexpensive Disks (RAID)", ACM 8IQM0D Con- 
ference. Chicago lIRnds. June 1-3. 1088 Ht^ff^^i^^ 

20 the general sdution with respect to data rate 
matching in the form of accessing N synchronizBd 
OASOs k) paraReL Synchronous behavk)r reqdres 
N DASOs to rotate at the same ipm. have the 
same angular offeet and be accessed in an Uen- 

25 tkal manner at the same time. 

As an ahemafive to communicaf^ data In 
parallel via Patterson*^ synchronized DASD's, data 
rate mismatch has been managed by biterlocks or 
lockaWe buffers. Buffer size and cost have re- 

90 mained as obstacles, .j x , 

Beausolea ^ al, U8P 3^^ *lntedockad 
Conununk:atkm System*, issued Au^nist 15. 18S7. 
. shows an iritBrk)ck over whidi a km speed proces- 
sor paces the transfer ftom a Mgh speed proces- 

ss sor. That is, a tow speed processor such as a 
storage control unit (IBM 3880) strobes a 
CPU/diannel @O70) over a demand response in- 

terftee todtoaUng that it Is available to process the 
next Information unit 

40 Cage. USP 4.454.505. 'Buff^ R)r Use With A 
Fbced Disk Controller*, Issued 6/12^1884, disdoses 
a multi-ported random access roemoty managed 
bf address register manipulatton as an asyndvo- 
nous partitkxied circular buffer. Data is read from 

45 or written into consecutive RAM addresses on a 
partitton-at-e-tinte basis fai wrap-around (cfacular) 
order. A parlition/bk)ck consists of a fbM number 
of consecutive fWM addrssses sized to hold a 
track sector of data, the RAM buffer having a 

60 capacity of at least two such partitions. 

k) Cage's buff^, the speed of the movement of 
fixed btocks of data Is matched between the main 
m mory (DMA) of a word processor and an at- 
tached DASD. A DASD write or read oonvnand 

65 resutts in data being moved either from the DMA or 
a DASD track sector into a first RAM partition. 
Because RAM operattons ana asynchronous, a de- 
nnand transfer from a second RAM partition can be 
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overtapped with the first nKMimni as an atomic 
part of the command (DASO read or wrtte) being 
exocutad. 

Knuth. The Art of Computer Programming*. 
Second Edmon, oopydght Addison-Wesiey Pub. 
Co. 1868. 1973, Vol.1 Fundamental Algorithms, 
peges 234^. S31-634. describes a "deque* as a 
finear list In wttfch all Insertions and deletions are 
made at the ends of the Qst He further defines an 
"input restricted deque* as a linear est In which 
Hems may be Inserted at one end and removed 
from the other end (8002.2.1 Exercise 1). 

DieciosurB of th e Invention 

The Invention provides a method of passing 
tasic messages In a data processing system Indud- 
btg a plurafity of high-speed processors, an exter- 
nal stOTBoe subsystem, and shared Intamal mem- 
ory, said method comprising the steps of: defining 
a first linind ist In the shared Internal memory wHh 
separately lockaUe first and second ends: and 
operating saki fist as a queue of task messages 
passing between the high-speed p rocessor s and 
the atoreoe subsystem, lockably enqueuing task 
messages at the first end of «te queue and bi- 
dependentiy todcably dequeuing task messages 
from the second end of 0)0 queue. 

PrafiarBUy the method listher oomprtses the 
eteps of dsfMng a second MBBd fist in the shared 
internal memory vvWi separately iockable first and 
second ends; and operating s^ second 6sl as a 
queue of task messages passing between the high- 
speed p roces so r s and flie storage subsystem, ^rith 
task messages being kx*Bbly enqueued by the 
external storage std)syslBm at the first end of the 
queue, and independently task ntessages being 
tockaUy dequeued by the high speed processors 
from the second end of the queue. Correspond- 
ingly, on flie first fist task messages are enqueued 
at 88dd first end of file queue by file tdgh-speed 
processors, and dequeued from the second end of 
the queue tyy the external storage sut)$ystem. 
- In a prefened embodiment, reference points 
and operator eels era defined over aaM first and 
second fists, one raferenoe point being assodated 
with the second end of each Ost, and each operator 
set Including top of Ost (TOO) and bottom of list 
(BOQ) pobiters. and top of list (TOOL) and bottom 
of fist (BOOq kx:kwords. Afirsi took Is obtained by 
one of the processors on sakl second end of the 
first fist upon sakS one processor matching fh 
BOQL, whereupon task messages are embedded 
between fi» refiarenoe point and the last mesaage 
In the fiat, and said first kx* is released. A second 
kx:k can be obtained by the subsystem on said 
first end of the first fist upon said subsystem 
matching fiw TOQU sHowing one or more task 



messages to be ramoved from said first fist before 
aaM second kx3k is leleassd. Only fiie hokter of 
saM second kx* (TOOL) may alter any pointer to 
file norHeferanoe end of the list or any of file task 
6 messages in file fist and only file hokler of file first 
kxM (BOQt) may alter any pointer designating ttie 
reference point end of file Dst 

It is also praferred that ttie processors ortginate 
task messages in the form of control bkxics 
TO (DCB's) for file subsystem, each IX)B specifying 
one or more access operafione to be eNecutad by 
sakI subsystom, sakl DCB's being enqueued on 
file first fist by file orfginafing prooeseora. and said 
subsystam dequeiAig and processing each DCB 
IB from add first Dst eccording to elthar an external 
disdpfine (UFO. fUO. FIFO) or eoconfing to a 
priorfty reordering of sakI first Ost or porfion fiiere- 
of. Each DCB essumes efiher a walling, acfive. or 
completed status, ttie waiting DCB's constituting 
20 file first fist, active DCB's being conentty pro- 
cessed, and completBd DCB*8 constituting fiie sec- 
ond fist The subsystom ttien processes task mes- 
sages dequeued from aaUf first Bst, updates each 
task messago. and enqueues tiie updated task 
as messages onto ttie second fist sakl oric^nating 
processors dequeiAig and pmcesskig each up- 
dated task message trom said second fist acoord- 
Ing to eittier an external disdpQne (UFO. FILO, 
FIFO) or to a prkxfiy reordedng of eakt second 1st 
so or portion fiioreof. • ^ 

The invention also provkles a data processing 
system Inchiding a plurality of highspeed proces- 
sors, an extamal storage subsystem, end shared 
Internal memory, saki system furttier inckxfing: 
as means fbr defirting first and second finked fists In 
file shared memory each wHh sepanBtaly kxicable 
fiist and eecond ends; means for operating saM 
first and second fists as watt and completion 
queues of task messages respectively, kxtebty 
40 enqueuing task messages at the first end of a 
queue and mdependentty kxAaWy daqyedng task 
messages from fiie second end of ttie queue: 
means responsive to task messages originating 
from processors for writing the task messages into 
4B ttie shared memory. DnUng saM task messages 
Into ttie watt queue, and sIgnalOng ttie skxage 
sut^system accordingly; means at the storage sd>- 
system aperiodicaity responsive to saM signalUng 
for dequeuing the task messages from ttie wart 
60 queue, actively processing ttie dequeued task mes- 
sages. enqu6«ilng ttie processed task messages 
onto the completion queue In said shared memory, 
and slgnatllng ttie processors eccordlngly; and 
means aperiodically responsive to ttie subsystem 
68 signals for dequeuing the processe d task mes- 
sages from ttie comple t ion queue. 

The above metttod and means pemntt proces- 
sors of disparate speed to have overlapped access 



EP0466339A2 



i 



to either add or remove messages In queued ao- 
cess (0osWon Older prooessin g) lelafion to each 
other. Thus prooessors such as a CPU and an 
external storage subsystem placing a message on 
a queue no longer have t9 wait on a queue lock eel 
|yy another processor or sut)6y8tem dequeubig a 
message. A doul>le ended Onked fist or queue of 
■hessages is used, preferably with an 
botetion/ireference point (NULUBU^NK). An en- 
queuing end of the 6st (BOQ/BOQL) Is locfcsble 
and oooessible independently from the dequeing 
end of the list (TOOmML). TVplcally the method 
and means utiliae simple metaimcessor bck 
pHroifives <fri this legatd* *meta-tNOoessor* de- 
notes available to all prooessois). The lockbig 
primithfom^ be of the muHHNooessor lock syn- 
chfOfdalng atomic type such as TEST AND SET. 
The processor obtains a k)ck. vvhen avaflabie, be- 
fore inserting niessages between the first end and 
the last message on the first queue, and then 
releases the todc likewise the subsystem obtains 
8 took, when available, before tosertbig messages 
between fiio first end and fiie last message on the 
second queue. Tlie avaflabOHy of a took can be 
tasted by oompaifson matchlno BOQL wtth the 
result from executing the kick prfmltiva 

Thus, in other words, task oriented messages 
c«i be passed between a pbraGty of high speed 
ptocessots aiKf a relatively tow^speed exiamal stor* 
age sub^fstem communicalively ooupM over a 
shared memory, using opposltBly pded queues. 
Firsl and second dense Enked finear fists are de- 
ftied in file sfwred memory, each fist having in- 
dependently tockaUe fM and second ends. A firet 
k)ck is obtained by a pmcessor on flie first end of 
file first fist when avaOaUe. file processor inserting 
messages between the first end and fiie last mes- 
sage so finked, and releasing sakf first kx*. The 
subsystem obtains anottier tockonttie second end 
of the first fist when avdiable. rsmovir^ messages 
anywhere on the fist and releasing sakf other k)ck. 
On file first and second ends of the second fist fiie 
roles of the storage sut>ystsm and p rocessors are 
reversed. 

Brief DescripBon of file Drawings 

Figure 1 shows a CPU/ OASD array data fiow 
emphasizing shared intemai memory, high perfor* 
manoe channel interface (HPO), array controller, 
and OASD*s. 

Figures 2ArC respecfivefy deptet a wait queue, 
an active fist, and a completfon queue of DASO 
control bkx4cs (DCB's) selectably tockabie at eittier 
endttiereof. 

Figure 3 Ifiustiatss fiie enqueue operation on a 
DCS wait and completion ^leue. 

Figure 4ArB sets fortti fiie dequeue operations 



on a respective first and second example of a DCS 
wait and completion queue. 

Detailed Description 

s 

The prefsnred embodiment of this kwention 
uses a high speed multi-processor host interacting 
witti a stower extemal store. The external store Is 
UiustFBtively expressed as a aynchronous anay of 

10 N DASD^ and an arr^ oontrofier. To enhance 
appreciation of this fbmn of extemal storage, a t)rlef 
description of data organization on the array 
(striping) and file use of information redundancy 
(parity bkicks. ECX) is provkled. 

IS Patterson^ type 3 OASD anray synchronously 
reads and writes to N DASOe In column nujor 
order. However. N-1 of ttie DASO's cont^ data 
and one DASD contains a parity ranc^ over ttie 
ottier data OASDs. That is. one check DASO is 

» provkled for the group. The contents of ttie failed 
DASO can be rsconstnjcted in tiie manner of 
Ouchi. US Pat 4X)92.732. -System for Recovering 
Data Stored in a Failed Memory Unit", issued May 
30. 1878. which disctoses ttie spreading of data 

28 btocks from ttie same logical file across a string of 
H- 1 DASO's and recording a parity bkxdc on ttie 
Ntti DASD. The parity bkick is an XORIng of ttie 
parity contents of ttie N-1 ottier blocks. Contonts 
from any single inaccessible DASO can be recov- 

so ersd by XORIng ttie parity btocks witti ttie btocks 
stored on ttie remaining accessibte DASD*8. A 
simnar result can be achieved if ttie parity btocks 
arenotavaiiable. 

TyptoaOy to btock oriented data, a parity sufifoc 
ss or equivatent (Hamming. CRC) Is appended to 
each data btock. Thus, each parity suffix csi be 
kwoked to deted/bonect lntr»btock enor. As de- 
scribed in OucM. when one or more of ttie btocks 
of «i N-1 sequence are unavailcdde. a parity btock. 
49 whtoh a priori spans the N-1 btock sequence, is 
used in cor^Junction witfi ttie remaining btocks to 
rebuild ttie unavailabto data btock. Bftoient codes 
per se (Hamming. Cydto fledundancy Check. 
Beed^Sotomon) are elsewhere treatod in ttie litera- 
ls tore. 

Refentng now to Figure 1, ttiere is ^lown a 
system including a an array of processors 1 oou- 
piing as extemal storage a synchronous DASD 
array a The pr o cessors S, 7. 8 are of ttie high 

60 performance variety such ttwt whan operated con- 
cunentiy ttiey have processing speeds In ttie onJer 
of 100^ MIPS. A stower special purpose processor 
in tiie fbrni of DASO anray 3 to couptod to anay 1 
by way of adapter I& Ottier infbrmation processing 

as 8ouroesor8bikBSuch8Stocalaraanetworic8.prktt- 
ers. or displays woukJ Gkewise be coupled over 
counterpart adapters 17. 

The fast and si w processor s communicate 
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wfthmanayl over a very Ngt) speed bus 11 using 
a portion or shanad bitemal ffUM 13 as a spedal- 
tod messaoe lepository. Tto processors amtHute 
a (fistnlxitad peer cou{^ system with no oentraf- 
Ized operating system or process control. All re- « 
sources such as internal memory 13. intenupl fa- 
dltty. and global registers (not shown) are available 
to any processor including the eodemal storage or 
DA8D array subsystem (DAS) 3. 

OAS 3 preferably comprises a RA103 type lo 
DASD array and an a ssod at ed anray oontroQer as 
described for example In the Patterson reference 
and in the ooi>ending Brady et sL appOcatkm. EP 
91304S03«5. -METHOD AND MEANS FOR AC- 
CESSINQ DASO ARRAYS VnXH TUNED DATA fs 
TRANSFER RATE AND CONCURRENCY*. 
(Applteanra ref. no. 8A»«MI2Q. Even Oiough OAS 
operates in a peercoupled relationship wHh the 
other processors, it nevertheless queues task ori* 
ented messages against other processors or re- 20 
souroes. Any change In the queue or other action 
requests such as halt cunant operaflon s are In- 
dtoatad by way of special pupose signals Oap 
signals). 

DAS raceives iBSfcs as messages and commu- 25 
rtteates the results of task processing via control 
bkxsks arranged in the form of a dedlcatBd queue. 
This queue, as axem p Bfled In Figure 2, remains in 
hosti bitemal memory 13. The system Includes a 
fad% to reorder the queue acconflng to dtangbig so 
system prtorlBes. ' - 

ReCenfng agsin to Hgure 1, fhere b'shown an ^ 
array contnoOer (elements 19-31) coupSng «ie host 
bus 11 by way of iiiannel adapter 15. TMs path 
provides access to aO system resources inducing ss 
memory 13. gtobal registers, and tap signals on 
behalf of OAS 3. Adapter IS preferably attaches 
DAS over a pair of simplex megabyte rate rec^ 
and transnA intedaoes 19. 21. The Interfaoes, 
loiown filso as High Perfomnance Parallel interfaces 40 
(HIPPO, are descrM In the ANSI Draft Standard 
of 8/29^989, X3TBn8-127. Revision 6A TMa fedli- 
tates receipt of the so-called tap signals from the 
host and access to the host as InHlatad by DAS. 

Host or system funcfions avtflable for DAS use 45 
Include READ/WRITE internal memory 13, atomic 
TEST AND SET for lodc operations in Internal 
memory 13. atomic operations on global registers, 
receipt and Interpretation of tap signals from other 
prooessor s or system elements, and the generation so 
of tap signals to ttie system or host. 

DAS 3 operates one addressable array of 
DASD*8 33. 35. 37 synchronized via sync circuit 39 
to each rotate at the same ipm. have the sam 
angular offeet, and be accessed in an Identical es 
manner at the same time. TWs solution maxindses 
data transfer rata. This permits high speed 8equer>* 
Hal or skip sequential DASD data transfer. 



Data movement in the Host/DAS direction 
starts trom bitemal memory 13 over bus 11 
through adapter 15. receiver 19. endng in strtping 
and parity logic 23. Logic 23 includes the neces- 
sary cfigita] and timing circuits to calculate a paifty 
blodc by XORIng the N-1 data bloclcs and transfer- 
ring counterpart Uodo to ones of the buffer and 
ECC circuits 27, 29. and 31. Each blocfc Is also 
p iotscted by appending an EOC byte theralD fbr 
error detection and correction on an lntra4>lock 
basis. Access to the N DASD^ Is made synchro- 
nously in the conventional manner. The obvereo 
obtdns whsn data movement proceeds In the 
OAS/Hostdireciion. 

The task or request Is defined in a control 
blocfc termed a DASD Control Block or OCB. A 
processor at the host buikls a DAS DCS in Intemal 
memory 13. it then finks the DCS to a WATT queue 
for DAS and signals the enqueuing operatkm. Sub- 
eequentty. DAS moves the DOB onto the ACTIVE 
LIST, performs DCS requested fundtons. updates 
the DCS and plaoes it on the COMPLETION 
queue. After detscfing the UO oompletkin. the host 
dequeues the updated OCB from the COMPLE- 
TION queue and ascertrins fte outcome of the 
D(» specified operafion. 

Restated, a OAS UO request Is re sponsh ^ to 
any processor &9 bivoMng a READ/WRITE from 
its OS. A OCB Is bdlt and plaoed on a WAIT 
queue tocsted In intemal memory 13. A tap signal 
Is then sent to DAS. In turn, the DAS Inspects «ie 
queue fdr fte nsKt queued D(S using any one of a 
number of work management algorithms (FIFO. 
RLO, UFO etc). DAS does not need to respond to 
the tap signal as a prtority event 

RefMng now to Figures 2ArC. the system Is 
arranged such that the DAS task WAIT queues* 
are priority ordered. A request may be rek)catad In 
the queue relative to other tasks or OCB's at any 
lime prior to its being made active by the DAS. In 
this InvenSon. such reorderi n g Is a special fundkm 
of a D^E operatton to be explained subse- 
quently. Note, that the OCB's remain at the same 
internal memory 13 real address Inespective of 
changes In queue Brddng prtority or acfiveAMaftlng 
status. 

One of the attributes of peer-coupted proces- 
sors is that the OAS Is responshre to receipt either 
of a tap signal or Its woric management algorithm 
by finding the next queued DOB via reading an 
anchor pointer In intemal memory 13 established 
during Inltlallzatlon and changing the first waifing 
OCB status from "WAITlng' to ^active. This Is 
aooompOshed by moving the DCS show In Figure 
2A to the ACTIVE LIST per Figure 28. TMs is 
brought about by the DAS ONecuting a sequence of 
Intemal memory access operaOons. Once the OCB 
is 'active*, the DAS processes the DOB according 
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a toicflon code contained (n said DC& Retatadly, 
address Infbmation m the DCB dMne ito 
data to be translBned. In ttils ragaid, the data 
transfer is effedualed by DAS initiated operations 
throu9h ttie diamiel adapter 15. 

It should be appredated that each DC8 can 
assume one of three states, namely, "active", 
Nvaitino". or "completed". 

When a data transfer operation is completed, 
the OAS writes completion status in the DCB, 
changes the DCS state as per F^ure 28 from 
*ecthre" to 'tonp l eted", and enqueues the DCB 
n ttie a ssoc iat e d completion queue per F^ure 2a 
Also, the OAS may execute a number of DCB 
specified completion notification pdmffives. Signifi- 
cantly, the transfer of data to and from internal 
memory 13 and the OAS is under DAS control* 

Rafenfaig stiD to F^ures 2A^ there are shown 
several queues of OCB's. Each queue element 
Oenerfcally called OEL, is a contiguous set of 
words in a memory which both processor classes 
can fetch from and store to fin shared memory 13l 
A DEL Includes message words as wen as a Knk 
pointor word required for queueing. Although each 
QEL could be a difierent length, advantageously a 
simple system might use uniform sized QEU of. 
perhaps, 32 words each. TyptcaDy. each shared 
memory woid itself consists of at least enough bit 
posifions to contain the address of any other word. 

example each word of shared inemory oouM 
bea4Ut8long. 

A pobitsr 10 a QEL is the address of one of the 
words In the QB. (as used in this specification and 
f=igures 2A-C, the tenn "pointer" retere either to an 
sddress. or to a place where such an address Is 
found). Context determines which is meant The 
word pointed to, tf)e Gnk pointer word, normally 
contains address of another QEU but can con- 
lain a prsdetennined null value such as all bits ofT. 
or all on. 

As lOustrBtsd F^ures 2A-C, a Biank-QEL Is a 
QEL whose Rnk pointer word is null Also, a queue 
may be formed from either a single Blank-QEU or 
a set of QELs linked one to another by pointers 
ieadng from a top QEL to a bottom QEL The latter 
Is always a Blank-QEL when the bottom pofinter is 
unlocked. 

Queues are k)cked by using a multlprecessor 
synchronizing k>ck operation available to all partici- 
pating multiprocessor classes. An example Is the 
classic Test and Set operatton whteh stores a took 
constant in a word of sTiared memory. If the pre- 
ceding fetch, whkii Is part of the same atomte 
operatton. returns a value other than this lock con- 
stant, then the Test and Set operation has success- 
fully kicked the k)Gk word. 

A queue header consists of four words in the 
shared memory as shown following: 



TOQ Top of Queue Pointer Shared mem- 
ory address of Bnk pointer word of the 
top QEL in the queue. 

BOQ Bottom of Queue Pointer. Shared 
a memory address of Onk pointer word 

of the bottom QEL in the queue. 

TOQL TOQ Lock Word. Ry example a Test 
and Set kx* word. Only the holder of 
the TOQ k)cfc may alter the TOQ 
to pointer or any of the contents of 

QELs linked above the QEL pointed 
toby BOa (Note that the BOQ poin^ 
er may change while TOQ Is tocked; 
see BOOL.) 

n BOQL BOQ Lock Word. Only the hokler of 
the BOQ took may alter the contents 
or the QEL at the bottom of ttie 
queue, possibly making it non-blank. 
Only ttie BOQL processorAiokler may 
20 change ttie BOQ pointer vahie, and 

ttien only if ttie new value Is ttie ad- 
dress of a vaOd Blank-QEL 
Changing ttie BOQ pointer moves ttie isolation 
point between ttie enqueuing and dequeuing pro- 
as cesses. Once ttie BOQ is changed, ttie BOQ lock 
hoUer^ auttiority to update Is reduced to ttie New- 
Blank-QEL and to ttie BOQ pointer. A TOQ kx:k 
hokler is always free to update any QBjs down to. 
but not including, ttie QEL pointed to by ttie BOa 
so whettierttieBOQistocloedornoL,p 

Applying ttie above definlttons to i^iurds^i^^ ^ 
ttiere are shown constnjcts indicative of ttie ttuee. ' / 
states Into .whteh each DCB must be resolved (wait \. 
actrae. completBdy.:DC8re classified -as, waithg or 
S5 completed are enqueued %vhile.w .acfive^0C8 is . 
b^ processed, bi each queue, each DCB has a 
pointer to ttie nod DCB in ttie chain. The BOQ 
points to a nuD or blank DCB .4)perB0ve as ttie 
queue bottom while TOQ points to ttie most recent 
40 queueaddttkm. 

Refenring now to f^ure 3. ttiere is depicted an 
enqueue operation as ttie k)ading of a message 
into ttie Btank-QEL at ttie bottom of a queue, and 
ttie appending to ttie bottom of ttie queue of an 
45 additional QEL as ttie New^Blank-QEL The en- 
queue operatkNi Mudes ttie steps of: 

1. tocking BOQ. conditionally waiting for ttie 
queue to become available; 2. writing a nun into 
link pointer of ttie additional QEL. "New-Blank*; 3. 
60 wrfting ttie memory address of New-Blank Into 
Linkage Pointer of OM-Blank; 4. toadli^ a message 
into ttie fbnmer Blank-QO^ *0k}- Blank*: S. putting 
memory address of New-Blank into ttie BOQ poim- 
er word; and 6. unloddng BOa . 
« The original queue fias not tweri attared except 
for ttie contents of ttie original Blank-CB. The 

original Blanl^QEL was biitiaily at ttie bottom of ttie 
qu ue. Only ttie prooessor/hoUer of tti TOQ lock 
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may altar the quou9*8 non-btank QELb. 

Tha anqueutng processor can ecSd moro than 
one QEL In pwparBl to n for enqueuing, the addi- 
tional QELa are to Bnlnd one to another from 
Top-AddnKIEL to Bot-Addnl-oa. The steps are 
listed bekm In an cider which continuously main- 
tains a weQ fornied queue. Note, a *well Itemed 
queue* refam to a TOQ-BOQ pair and Ha aaso- 
datad queue conforming to the above definitions- 

1. locking BOa pediape wiMng for it to be- 
come avaOabie; 

2. putlino mifl lito Bnk poinlar of BolAddnMEL. 
making It New^Blank; 

a foading messages into Okl-Blank. and all 

AddnMEU except New-Blank; 

4 putting memory addiesa of Top-Addni Into 

6nk poiMBr of OU Blank; 

S. putting address of New^lark Into BOQ; and 

a unfocUng BOa 

Rafontng now to Rgures 4A^, there are de- 
ptotad two OMBmples using a DEQUE operatkm In 
whk3h a dngle QEL is removed ftam the top of a 
queue. A processor copies Into the TOO the con- 
tants of the Onk pointer from the first QEL in ttie 
queue. To remove a continuously inked sequence 
of QELa, a processor changes the TOQ pointer, or 
a single QEL fink pointor, so es to point around Vie 
QBjs being removed. The dequeue stops are Is^ 
ed befow in an order whteh continuously m^nWns 
a weO formed queue. - ' 

1. if TOQ « BOa exiting without tocMng es 
queue to empty of noThUanks; 

2. tocking TOa condiSonaOy after waMng for n 
to l)eoome aevana!)le; 

a reading BOa any QEL at that address or 

Bnfcad beyond it Is ineiigibto; 

4. remo^ one or more eOg^ QELs fipom 

anywhere on the queue; and 

a untoddng TOQ. 

The QEL pototod to by BOa wben BOQ Is 
read, is treated as IneltgQte. While a BOQ took 
hokler may make this a vaU QEL and may change 
BOQ, the QEL will remain ineB{^ for this exscu- 
tion of enqueue or reorder. 

Reordering to a two step process to which 
OEMs) are first dequeued from, and then r^nser- 
ted into, the ellgibto QEL chain. The processor 
doing the reordering holds the TOQ took tor the 
duratton of both steps. So to move a single QEU 
called "l/tovlng<2EL*. to the top of the queue, a 
prooesso re dequeues the QEL, as defined pre- 
vtously. and then reinserts It by changing Movfng- 
QEL*s Qnk poimer to the value In TOQ, and putting 
the address of Movtng-QEL into TOQ. 

to a aimnar manner a processor can dequeue 
any number of eligible QBjb, Onk them together to 
one or more fragmentary chains, and then rrtnsert 
the fragments back Into the queu . Reinsertion can 



be done malntolning a weU ftormed queue br* 
1. setting ink pointer of tragmen ra final QEL to 
addresa of QEL that win foOow tragment In 
queue; and 

a 2. setting TOQ pointer, or Onk pointer of QEL 
that is to precede fragment to the address of 
first QB. to fragment 

For any operatton to continuously maintain a 
wen fomwd queue, each single word storage up- 

ro date of a polrrter to shared nmnory must complato 
fuUy. If a prooesa then foOowa the steps of an 
operatton to the order given, the queue win remato 
weOfbrnied. to the event of most hardware f^tores, 
or of a premature process terminaliort eome In- 

16 transit QELs may not be on the queue, but the 
queue Heelf wUI remato weO formed. Other pro- 
cesses win be abto to oonftwe woitdng with audi a 
queue. 

to the initial example the anocatton of shared 
20 memory can be a processor only funcfion. This can 
!» achieved by having the oonUoiie re reuse each 
work queue etemem as the QEL to wMch to report 
oompleSon ^ t fttua 

28 Ctalms 

1. A method of pasdng task messages in a dato 
processing eyetem inducfing a pluralily of high- 
speed prooessore ^, 7), an e)dBmai atorege 
so subsystem (3), and shared internal memory 
(isy. aaM method comprising the steps of: t . 

defining a first finked fist to the shared 
internal memory with separately tockabto first 
as and second ends; and 

operBBng add fist as a queue of task mes- 
sages passing between the MgMpeed prooee- 
sore end the etorage subsytem, tockaUy en- 
40 quedrv task messages at ttie first end of file 
queue and independently tockabiy dequedng 
task messages trom the second end d fiie 
queue. 

45 2. A method as claimed in daim 1, In which fiie 
task messages are enqueued at aaid first end 
of the queue by the high-speed prooessore, 
and dequeued from the second end d the 
queue by the extemd storage sut>system. 

so 

a A method as ddmed to daim 2, hirther oom- 
prlslng the steps of: 

defining a second Bnked fist to the shared 
66 intema] memory with separately tockat)te first 
and second ends; and 

operafing add second Ost as a queue of 
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task messagos passing behwaen iha Mgh- 
spaed p rooaas c r a and iha Storage aubaystem, 
task megsage a being k)cfcably enqueued by 
the external storage subsystem at the first end 
of the queue, and independently task mes- 8 
sages being lockably dequeued by the high 
apaed processors from the second end of the 
queue. 

4. A method as claimed In daim 3, further com- lo 
prising the steps of: 

dating leforonoe pobita and operator sets 
over aaid first and second lists, one reference 
pdnt t)eing associated with the second end of is 
each fiat and each operator eel Including top 
of fist (TOO) and bottom off fist (BOO) pointers, 
and top of fist (TOCa) and bottom of fist 
(BOQL) lockwords: 

20 

obtaining a first tock by one of the proces- 
sors on aski second end of the first fist upon 
saW one processor matching me BOQL, em- 
bedding task messages between the rsference 
pdnt and the last message In fiie fist, and as 
feieasing saM first todc 

obtaining a second tock by the subsystem 
oneaklfiistendofthefirBtfist upon saM 
aubsystom matoMng theTOGU^ femoving one . so 
or more task messages from sM fkst fist, and 
releasing sM second tock. 

& A method as claimed In daim 4, wherain only 
the hdder d said second todc . (TOQl) may ss 
aKer any pdntor to the non^efarance pdnt end 
of the fist or any of the task messages in the 
fist and further wherein only the hdder of the 
first tock (BOOg nrwy attar any pointer des- 
ignating the rsfdfonoe pdnt end of the fist 40 

6. A method as claimed In any preceding daim. 
wherein said method further comprises- the 
step of: 

46 

feoiderfng the fist of task messages by 
obtaining a tock on the second end d the first 
list when available, removing task messages 
from anywhere on the fist. Unking 8t least some 
of the dequeued task measagea together In so 
one or more fragmentary chains, and then rein- 
serfing the tnagmentary chains back into fho 
queue, and releasing th tock. 

7. A method as dabned in any of dafana 2 to 6. as 
wtwein the processors ortginate task mes- 
sages In the fbrni of contrd btocks (DCB*s) for 

the subsystem, each DCB specifying one or 



more access operattona to be executed by 
said subsystem, add DC8^ being enqueued 
on the first fist by the originating p rocessors, 
and said subsystem dequeuing and processing 
each DCB from sakf first fist acconfing to 
either an external disdpline (UFO, HLO. HFO) 
or aooortfing to a priority reordering d said 
first fist or poriton thereof. 

a A method as claimed In daim 7. wherein each 
DCB aaaumas either a waitfng, acfive. or com- 
pleted atotus, the walfing DCB'a constituting 
the first fist active DCB'e bdng currently pro- 
cessed, and completod DCS^s oonstitufing the 
second asu 

a A metfK>d as claimed In daim 7 or a wheidn 
the 8ut>systam processes task messages de- 
queued from sato first fist updates each task 
message, and enqueued the updated taak 
me ssa g es onto the second fist, said ori^nating 
processors dequeuing and processing each 
updated task message from sakl second fist 
accortBng to either an extenul discipline (UFO. 
FILO, FIFO) or to a priority reonterirHl d add 
second list or porflon ttiera d. 

ia A data processing system indudng a phvafity 
d Mgh^spaed prooeaaors C6. 7). an extemd 
atoraga subsystem (3). arid shared bttemd 
rnamory 0^ saM system further indudir«i: 

means for ddining ffast and second finked 
fiste In file shared mennory eadi witti sepa- 
rately todcade Ifast and second ends; 

meana for operating aald first and second 
fists as wait and completion queues d task 
messagee respectively, tockably enqueuing 
task messages at the first end d a queue and 
independently tockably dequeuing task mas- 
sages from the second end d the queue; 

means responsive to task messages origi- 
nating from processors for writing the task 
messsges into file shared memory, finking said 
task messages into trie wdt queue, end signal* 
fing the storage subsystem accordingly; 

nieana at the storage subsystem 
apertodlcally responsive to sato signalOng for 
dequeuing the task messages from the wait 
queue, actively processing the dequeued task 
messages, enqueuing the processed task mes- 
sages onto ttie completion queue to eato 
shared memory, and dgnafling the processors 
eooordingly; and 
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means apeilodicaUy responsive to the sub- 
system signals tor dequeuing ttie processe d 
task massages from the completion queue. 



f6 



28 



35 



40 



45 



60 



65 



EP0466338A2 




10 



EP0466338 A2 



WAIT QUEUE 
















WAIUNG 




WAimiG 




WAITING 




DCB 




0C8 




DCS 






ACHVEUST 



ACTIVE POINTER "A" 
ACTIVE POINTER V 







IGNORED 


»NULl 










ACTIVE 






DCB 



COMPLETION QUEUE 

















NULL 


COUPIEED 




COUPUEIED 




OOUPIEIED 






BLANK 


DCB 




DCS 




DCS 






DCB 



TDQ - TOP OF QUEUE POnfTER BOQ » BOTTOM OF QUEUE POINTER 



RG. 2 



11 



EP0466339A2 



ENQUE 



BEGIN EXAMPLE: 

QUEUE IS OU) BLANK 
ENQUEUE NEW BLANK 





00 ENQUEUE: 

SET BOQ LOCK 
NULL P1R IN NEW BLANK 
LOAD MSG IN OLD BLANK 
LINK OLD BLANK TO NEW 
CHANGE eOQ ft UNLOCK 



TOO — 
BOQ— 1 









NUll 


OLD 






NEW 


BLANK 






BLANK 



ANOTHER EXAUPL& 

TOO 

BOQ —1 



QUEUE OFN 













NULL 












OLD 

BLANK 




00 ENQUEUE: 
TOQ — 
BOQ —1 



N 



Nfl 



HOLDER OF BOQ LOCK COULD ALSO HAVE UNKED 
ADDI1K1NAL ITEMS BETWEEN OLD AND NEW BLANK 

















NULL 










MSG IN 

OLD 

BLANK 






NEW 
BLANK 



RG. 3 



BNSOOctO: <CP__04aea3aA2j^ 



12 



EP0466338A2 



DEQUEUE 
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